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PREFACE 



This study was undertaken on behalf of the Governor's Commission 
on Educational Reform, State of California, using resources provided by 
a grant to 'The Rand Corporation from the Carnegie Corporation. Its ini- 
tial scope involved study of the educational information-system require- 
ments within California, with specific emphasis on the information needs 
associated with program budgeting and accountability. 

As the study evolved, the information-system considerations under 
examinatior /ided some interesting perspectives on the practical na- 
ture of accountability systems. As a result, this report is broader in 
scope than was originally intended, addressing aspects of the nature, 
purpose, and practice of accountability as well as the characteristics 
of an information system that would provide support in other areas of 
educational decisionmaking, such as financial accountability, curriculum 
planning, scheduling, and operations. It also provides both specific 
breakdowns of accountability information needs and flows within a school 
system, and a specific plan of action for a follow-on to the California 
Educational Information System (CEIS) to fully realize the potential 
value of the current CEIS. 

The report should be of particular interest to educational planners 
and administrators concerned with the operational implications of possi- 
ble accountability systems. 
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SUMMARY 



A groat deal of attention Is currently being directed toward public 
education. It is felt in some quarters that the answer to public and 
political demands for a more responsive educational system might lie in 
the practice of "accountabi lity" — holding educational planners and ad- 
ministrators responsible for educational outcomes. A variety of methods 
for realizing accountability have been proposed; three alternatives are 
performance contrs.cting, decentralization and community control, and the 
voucher system. 

The future implementation of program budgeting in California may 
offer an attractive vehicle for accountability. Program budgeting can 
be of considerable assistance to the educator and to the public in under- 
standing the relationship of education inputs (human end material re- 
sources) to outputs (educated students). 

The implementation of accountability through program budgeting re- 
quires comprehensive information suppose. Program planners will require 
exhaustive data on community objectives, program progress, and student- 
body characteristics. They will also require information on the short- 
and long-term resource implications of various educational strategies. 
Similarly, information must be provided to administrators, legislators, 
and the public to allow them to equitably Judge the progress of the edu- 
cational system and the impact of various alternatives. 

Many California school districts now utilize the California Educa- 
tion Information System (CEIS) as a primary vehicle for information 
storage, processing, and retrieval. The current configuration of CEIS, 
although adequate for present needs, will be hard-pressed to effectively 
support accountability and program budgeting. In addition, it is un- 
likely that the current political and financial climate will allow CEIS 
to evolve toward such support. 

For this reason, we recommend that the Legislature create an Advi- 
sory Commission on Information Systems to define the structure and ser- 
vices of CEIS II, a statewide information system designed in support of 
accountability and program budgeting. The Advisory Commission would be 
charged with defining the information needs associated with these 
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concepts and determining the costs, benefits, and economic and legal 
framework most attractive for effective usage and continued growth of 
CEIS II. 

This report defines a suggested development plan for CEIS II design 
and implementation, structured as follows: 

o Phase I: System Definition ( June 1971-May 19 72) --This phase 
would be used to determine information needs, transitional 
mechanisms (from the traditional environment to program budget- 
ing and accountability), functional system design, legislative 
and economic framework, and Security and privacy issues, 
o Phase II: Detailed System Design (March 1972-May 1973) — During 

this phase, the information needs and design guidelines estab- 
lished in Phase I would be translated into detailed specifica- 
tions for subsequent programming. This phase would also include 
hardware selection and detailed file design, 
o Phase III: Prvgra/rrring and Acceptance Test (June 1973-August 

1974) — Phase II results would be translated into computer pro- 
grams. Hardware acquisition would also be carried out during 
this period. 

Implementation of CEIS II should proceed deliberately from this 
point, gradually widening (following exhaustive shakedown' r periods) to 
serve the entire California system of public education. Sufficient fund- 
ing and legislative impetus must also be provided to insure that CEIS II 
remains an evolving, dynamic tool to meet the diverse needs of public 
education . 
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I. INTRODUCTION 

The current turmoil in education stems from a variety of sources. 
Students clamor for more relevant education, parents for more effective 
teaching, and educators for more resources to meet these demands. Yet 
the electorate appears to have reached the point where no further mone- 
tary contribution will be made until overwhelming evidence of effective- 
ness and need is presented. The voters have perhaps begun to view the 
educational system as a bottomless pit into which money is poured with 
little definitive return. The dissatisfaction is evident in disapproved 
bond issues and tax elections. Public education thus faces the problem 
of trying to meet escalating expectations with existing resources. 

Accountability offers a possible remedy for a number of present 
dissa tisfac tions . A concept popularized by Lessinger [1], ac , tability 
involves measurement of educational progress and achievement, coupled 
with identification of the human and material resources to which the 
achievement (or lack thereof) may be attributed. In theory, accounta- 
bility may function at every level of the educational process: teachers 

may be held accountable for ^lass performance., administrators for school 
performance, and so forth. Ultimately, the various segments of the ed- 
ucational community are accountable to the voters, who control a portion 
of the financial resources and who have the power to change state and 
lotal administrators. 

Effective practi e of accountability requires support in at least 
four areas : 

1. Objectives of educational programs, to provide a basis for 
judging success ; 

2. Effective methods and criteria for measuring performance; 

3. Identification of resources expended; 

4. Information systems to aid in relating objectives and re- 
sources to educational outcome and to provide status informa- 
tion for use by teachers, administrators, and the public. 

Program budgeting (also referred to as the Planning-Programming- 
Budgeting Eystem) is a resource-allocation system. It involves 
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establishing objectives, identifying or establishing programs to ac- 
complish these objectives, identifying resources, and measuring the 
effectiveness of selected programs. Therefore, program budge ting con- 
siderably aids decisionmakers to perceive relationships between resource 
expenditure and educational outcomes. It allows them to plan the edu- 
cational process in a coherent and rational manner by providing a set 
of concepts and procedures for evaluating the present and future impact 
of educational progranr. 

This report addresses the fourth area, information systems. First, 
we examine in some detail the form of goals, programs, and evaluation 
mechanisms because these substantially determine the shape of the nec- 
essary information system. This report examines these items in the 
context of accountability and program budgeting to indicate the breadth 
and depth of the information required for educational planning and 
adminis t ration . 
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IX, ACCOUNTABILITY AN D PROGRAM BUDGETING 
ELEMENTS O F ACCOUNTABILITY 

The effective and equitable practice of accountability requires a 
coherent framework of concepts, methods, and techniques. Three of the 
most important items are 

o Goals and objectives, 

o An evalua tional methodology, 

o An incentive structure. 

In addition, accountability requires an understanding of who is 
responsible for specific outcomes and to what extent external factors 
mitigate that responsibility. Accountability also requires considera- 
ble information allowing decisionmakers to relate (1) goals and objec- 
tives to achievement, and (2) measures of achievement to resource 
expenditure . 

Goals and Objectives 

An essential element of accountability is a standard against which 
performance is measured. It is unrealistic to practice accountability 
without first involving educators in the formulation of precise and 
realistic objectives. In many cases, these are the behavioral objec- 
tives arrived at for individual classes. These generally relate to 
specific ip-class achievements. Behavioral objectives may be too spe- 
cific — or too diffuse--for realistic measurement and achievement. 

The introduction of program budgeting can be of considerable as- 
sistance in formulating goals and objectives. The program-budgeting 
process first establishes educational objectives and then establishes 
and assesses the resource implications of various alternatives. Pro- 
perly established program objectives form the basis against which edu- 
cational outcomes may be evaluated. This is done by breaking down 
program objectives (and programs) into component parts convenient for 



For comprehensive treatments of the subject, see Ref3. 2 and 3. 
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specific evaluation. A full accountability system might best use both 
behavioral and program ODjectives — properly related — as benchmarks. 
Behavioral objectives are most appropriate, for judging the performance 
of individuals; program objectives are attractive for evaluating over- 
all school or district performance. 

Evaluation 

Evaluation involves measurement. Measurement of educational 
achievement can combine a wide variety of objective and subjective mea- 
sures, all subject to diverse interpretations. Evaluation by teaching 
personnel is based in part on such quantitative measures as test scores. 
In large part, however, it is currently carried out subjectively: teach- 

in-. personnel evaluate a student’s performance by observing his inter- 
action with all facets of the school environment. 

It is important to point out the r elative nat re of accountability. 
Educators cannot be held responsible for educational achievement without 
full cognizance of factors beyond their irfiuence. For example, it is 
unreasonable to expect that two teachers-- one responsible for a class 
of economically advantaged students and one starting with a class of 
disadvantaged students — will have identical reading scores at the end 
of one year of ’’effective" teaching. Full account must be taken of a 
variety of factors that are external to the educational institution 
but that influence educational performance. 

If accountability is to function in an equitable and effective way, 
more realistic (and perhaps complex) evaluation strategies, methodolo- 
gies, and models of performance must be developed. Until this is done, 
results of evaluations must be carefully examined and weighed. How- 
ever, it is unrealistic to say that a judicious accountability system 
must await the developments Sketched above. Instead, gradual progress 
toward full accountability can be an effective impetus to development 
of evaluation techniques by both spurring and shaping the necessary 
research . 

^For a full treatment of the pitfalls inherent in interpretation, 
see Refs. 4 and 5. 
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Incentives 

Incentives are an integral part of proposed accountabi 1 tty systems: 
if teachers and administrators have no financial or institutional in- 
centives, it may be virtually impossible to use accountability as a 
means for improving educational outcomes. 

It is in no way clear that incentives currently extant in public 
education are sufficient to support an accountability system. Never- 
theless, for purposes of discussion we assume that they are. Present 
incentives include: 

1. Teaching profession: (a) promise of advancement within teach- 

ing, (b) opportunities for assuming administrative responsi- 
bility, and (c) accompanying economic incentives. 

2. School administration: (a) opportunities for advancement, and 

(b) existing economic incentives. 

?-. District administration: (a) existing economic incentives, 

and (b) school-board performance review. 

4, School boards: (a) public scrutiny, and (b) electoral control. 

5. State admiiris tixition: (a) legislative scrutiny, and (b) 

electoral control. 

ALTERNATIVE ACCOUNTABILITY SYSTEMS 

This report is specifically oriented toward near-term accountabil- 
ity, that is, practiced within the current educational environment and 
organizat ional structures. Other organizational structures, evaluation 
methods , and incentives have been discussed as effective measures to 
introduce accountability. Five of these, enumerated by Barro [6], are 

1. Institutie ilization of External Evaluation: An impartial 

agency evaluates programs and reports results to administra- 
tors and to the public. 

2. Extension of Perform Tice Incentives: This has been put forth 

under the term "merit pay'* and involves rewarding accomplish- 
ment through increased remuneration. 
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3. Performance Contracting: Contracting with an outside agency 

to perform educational functions and varying payment based 
upon the effectiveness of the services rendered. 

4. Decentralization and Community Control: This involves making 

the school directly responsible to the community at an opera- 
tional level, usually by establishing several local boards 
where one central board previously existed. 

5. Competitive Public Schools : Provides parents with educational 

"vouchers" — documents that allow them to enroll their children 
in the school of their cnoice. If parents are dissatisfied 
with the quality of education at a particular school, they may 
simply transfer their children widbjut regard to district 
boundaries . 

Each of these five approaches is attractive to sotr.e observers. 

Each, of course, has its individual drawbacks. Some combinat ions a Lght 
be used, e.g., both "External Evaluation" and "Performance Incentives." 
Implementation of any alternative would require considerable restruc- 
turing ol the educational system. Implementation of an accountability 
system must not be made to wait upon such restructuring. 

PROGRAM BUDGETING 

Program budgeting is a resource-allocation system that provides 
the user with a set of convenient and powerful tools for judging where 
money and materials might best be expended. Program budgeting Is more 
than an accounting system; it embodies a philosophy of rational resource 
allocation and evaluation. 

'Figure 1 illustrates the nature of program budgeting. Each of the 
four components of the process has associated activities that must be 
carried out by the decisionmaker. These components and activities are 
described below: 

The first component concerns the structural aspect . This 

involves the setting of objectives and the development of 

a program structure. These are interacting activities. 








activities components documentation 
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Attempts to identify groups of programs that, either singly 
or in combination, help to meet objectives will also help 
to clarify objec.ives. Conversely, clarification of the 
objectives will facilitate the task of grouping program ele- 
ments into programs. 

The second major component of program budgeting is the 
analytical aspect . It is within this area that the cost- 
effectiveness analyses and tradeoffs are made. It is in 
this area also that the generation or identification of al- 
ternative ways to meet objectives most often takes place. 

The third major component of program budgeting is the con- 
trol aspect . Basically, th f .n involves keeping tabs on how 
ell a new program is being implement ed and recording pro- 
gram changes — in other words, progress reporting and control. 

In the fourth component of a program budgeting system is its 
d ata and information aspect . The analytical component of 
p gram budgeting influences the choice of data. As the 
successful implementation and utilization of the System pro- 
gresses, certain data appear that were not evident before. 
These data then become useful, not so much as an end in them- 
selves, but rather because they support the analytical part 
of the process , t 

THE RELATIONSHIP OF PROGRAM BU DGETING TO ACCOUNTABILITY 



Accountability is a concept, an idea; program budgeting is a con- 
venient structure for and implementation of accountability. It may be 
possible to effectively use program budgeting without practicing ac- 
countability, Likewise, accountability may be practiced without pro- 
gram budgeting. However, each greatly Supports the other. 

Program budgeting provides objectives and criteria that are 
tailor-made for accountability in that (when well-conceived) they re- 
present rational expectations tied to specific programs. The efforts 
of administrators in the planning process are fully displayed, provid- 
ing an excellent basis for judging that administrator’s performance. 
Similarly, his day-to-day attempts to manage the chosen programs become 
much easier to evaluate. The seme is true of teacher performance. Al- 
though accountability may be supported In other ways, program budgeting 
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offers a most effective working framework for establishing and evaluat- 
ing educational strategies. 
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III. INFORMATION NEEDS ^ FOR ACCOUNTABILITY 

Before we can establish information needs, we roust examine the 
organization and structure of a school system and determine who is 
accountable for which outcomes. Therefore, we sketch a "typical" Cali- 
fornia school dissect that incorporates the characteristics of several 
districts and schools. Since public educational institutions have much 
in common, the example should be relevant to nearly every school dis- 
trict within the state. 

SCHOOL DISTRICT ORGANIZATION 

Figure 2 shows a typical school-district organization. It in- 
cludes only those functions considered district responsibility and 
only those individuals located in the district offices. 

District and school operations are examined as two distinct activ- 
ities: instructional and financial. School systems often appear to be 

two separate and parallel entities. Program budgeting provides a means 
of relating and bringing together the two activities. 

Figure 3 illustrates the organization of an individual school and 
the particular areas for which each administrator is responsible. 

ACCOUNTABILITY IN THE INSTRUCTIONAL STREAM 

Basically, educational personnel are held accountable for three 
gene ral areas : 

o Education planners are judged on (1) whether or not the chosen 
goals are desired by the school board, community, and state, 
and (2) whether or not the programs established effectively 
meet these objectives. 

o Educational administrators are judged on their ability to moni- 
tor and administer the programs so as to bring about success- 
ful outcomes (if objectives and program design are sound). 

o Teaching personnel and related administrators are judged on 
their ability to bring about the behavioral and educational 
outcomes stated in the objectives and implicit in the educa- 
tional program structure. 
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Goals and program structure must be associated both with the speci- 
fic individuals who conceived them and with those responsible for admin- 
istering and executing them* Personnel should not be held accountable 
for decisions not explicitlv assigned to them. Similarly, a single in- 
dividual should not be held accountable either for group decisions or 
for decisions arrived at according to established policy. 

One must distinguish between legal accountability and accountabil- 
ity as a management technique* Legal accountability holds supervisors 
responsible for all action taken within their domain, whether initiated 
by themselves or by a subordinate. Legal accountability practiced in 
an educational context might well eliminate most initiative and creativ- 
ity from the system, with everyone following "the book' 1 or the safest 
course of action. Therefore, accountability as a management technique 
would only hold an educational manager directly accountable for his own 
decisions * 1 

I NFORMATION FOR ACCOUNTABILITY 

Each individual in the accountability chain needs two sets of in- 
formation: (1) information for setting objectives and designing pro- 

grams, and (2) information for ongoing administration and instruction. 
These two sets sometimes overlap considerably. 

The educator setting goals and planning programs must have consid- 
erable information both on the strengths and deficiencies of the student 
body and on the capabilities of the instructional staff. This informa- 
tion allows him to set realistic objectives. In addition, he must pos- 
sess a wealth of more subjective information on the needs, desires, and 
priorities of the community, the job market, and institutions of higher 
education.' Finally, he must possess resource Information as a means of 
determining the costs of various potential programs. Figure 4 summa- 
rizes the information necessary to the program planner. 

^Ideally, the organization should be structured to make legal ac- 
countability and management accountability coincide. Since for many 
reasons this cannot be done quickly, provision must be made for operat- 
ing within current structures. 
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Demographic data 8. Allocate and assign: (Instructional Assignment notification 

Teacher skill and Interest profiles Strategy) 

a. School administrators 
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Administration of planned programs requires primarily student and 
teacher information* coupled with the data provided by ongoing evalua- 
tion, Figure 5 displays this information and its related educational 
function. Basically, the same information concerning a particular func- 
tion is provided to each Individual; reports differ in the degree of 
aggregation of the primary data elements. 

PUBLIC INFORMATION 

The final point of accountability is the voting public. This is 
not simply an accountability "option 11 to be included or excluded de- 
pending upon the will of district administrators. Public information 
must be provided if accountability is to work. A significant award 
for educational success is more money for salaries, equipment, and 
facilities. To approve such expenditures, the public must be fully 
informed of educational results. 

The public will require not only information, but a vast amount of 
education concerning interpretation of data. Any school district that 
releases data without cor responding education is inviting disaster through 
misinterpretation. Although the educational porrion of public informa- 
tion falls outside the bounds of this report, it should not be neglected 
by educators. 

Information that ratJS one school against another should be pro- 
vided only if parents are free to send their children to alternative 
schools. If this is the case, they have the right to know which is 
the "better 11 school . 

In any case, the primary information provided should allow the 
public to judge their state and district in relation to all other dis- 
tricts and states. Because such data will be used for comparison pur- 
poses, they should be corrected for cultural and economic factors. Data 
provided to the public should also relate resource input to educational 
output. Any results disseminated to the public should be accompanied 
by publication of objectives and descriptions of the programs designed 
to meet these objectives. 
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ADMINISTRATION 




INFORMATION INPUTS 




FUNCTION 


INFORMATION OUTPUTS 


Grade reporting 

Test reporting, attendance reporting 


1. 


Monitor educational r itcomes 


Investigation of exceptions; 
restatement of objectives 


Recurtlug expenditure reporta 


2. 


Monl tor expenditure 


Investigation of exceptions; 
remaining fund* budget 


Combination of educational outcomes 
and estimate of available budget 


3 » 


Allccata discretionary Items 

a. Taak forca ptraonnel 

b. Speclallate 

c. Aldea 




All data gathered 


4. 


Raport progresa to public 


Board briefings "fact ahaat” 


Attendance data 


5. 


Report average dally attendanca 
(ADA) to Stata 


ADA summary 


Facilities data 


6. 


Allocate maintenance 


Assignment notification 






INSTRUCTION 




INFORMATION INPUTS 




FUNCTION 


INFORMATION OUTPUTS 


Resume of successful method* 
Demographic 

Program goala and objective* 

Stata syllabus 

Experience 


1. 


Eatiblteh Ine true t Ions 1 atrategy 


Instructional plan 


Experience 

Demographic 

Norm-referenced measures 
CrlteTion-rsfsrencsd measures 


2. 


Evaluate educational progreas 


Report cards 

Parent-teacher conferences 






COUNSELING 




INFORMATION INPUTS 




FUNCTION 


INFORMATION OUTPUTS 


Cumulative file 
Health data 
Taachar contact 
Behavioral referral form 


1 . 


Determine eauaa of behavioral 
referral* 


Poatlng to student cimiletlve 

files 


Cumulative file 
Teacher contact 
College placement guide 


2. 


Guide concerning aaplretlona end 
ccurat necessities, vocational 
opportunities, college placement 


n.a. 



0 



Fig. 5 — Information Needs for Administration 



Instruction, and Counseling 
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IV. PROGRAM BUDGETING , ACCOUNT A BILITY, AND 
CALIFORNIA IN FORMAT ION-SYSTEM POLICIES 



The information discussed in the preceding sections may be provided 
in a variety of ways: manual information and accounting systems i compu- 

ter systems operating at the school or district level, or purchased com- 
puter services. Within California, a service known as the California 
Educational Information System (CEIS) currently provides a working in- 
formation system for many school districts. Due to its wide use, CEIS 
represents a logical focus for examination of how automated information 
syster.;s might serve the needs described above. Alteration of CEIS would 
affect a large portion of California public education, both directly 
(for those it serves) and indirectly (through establishment of realistic 
and rational information system goals and service standards). 

This section examines CEIS in the light of the Information require- 
ments described in Sec. III. Four questions are examined: 

o How effectively does CEIS currently meet the needs of its user 
community? 

o Given likely patterns of system growth, how effectively will 
CEIS support accountability, program budgeting, and educational 
management ? 

o What CEIS posture and configuration migl t best meet these needs? 

o What steps might best insure that CEIS evolves into an effective, 
timely, and efficient support of accountability and program 
budget ing? 

CURRENT CONFIGUR ATION 

For purposes of discussion, CEIS may be divided into two large sub- 
systems: pupil and business. The question of interfacing these two 

subsystems --vital to the implementation of a program-budgeting system-- 
is discussed below. 
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Pupil Subsystem 

The pupil subsystem currently provides five services to the school 
dis trict : 

1. Attendance accounting, 

2. Test scoring, 

3. Grade reporting, 

4. Class scheduling, 

i 

5. Master-fiJe maintenance. 

The five services are somewhat unrelated. For example, the printed 
’’report cards” do not carry previous grades, nor are these grades re- 
corded within the system. Thus, CEIS may have limited usefulness for 
perceiving trends or for any contemplated longitudinal study. This 
also severely limits the quality of the ’’guidance reporting" because 
trends cannot be displayed or evaluated. 

B usiness Subsystem 

Although the business subsystem is not currently available through 
CEIS, it is being tested and implementation should be feasible by 1972. 
This service is comprised of five separate parts: 

1. Control system, 

2. Accounts payable, 

3. Stores inventory, 

4. Financial (general ledger, etc.), 

3. Personnel/payroll, 

A detailed presentation of the State Bureau of Data Processing 
describes the proposed business subsystem [9]. In general, this sub- 
system provides the minimum level of finance and accounting capability 
necessary to insure continued operation of a school district. 



An additional product of the master-file maintenance process Is 
a guidance report. 
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CEIS Operations 

Twelve regional centers operating throughout the state provide CEIS 
services to any school district willing to pay for them. Except for one 
center, which uses an IBM Sys tem/360 , nearly all regional centers cur- 
rently operate one or more Honeywe 1 l-H-200 computer systems. All CEIS 
regional-center communication is with the school districts. Except for 
an annual transmission of tapes to the state bureau, there is no commun- 
ication of data between Sacramento and the regional center. 

UTILIZATION OF CEIS 

The CEIS pupil subsystem currently Is used by about 33 percent of 
California's school districts, which are responsible for approximately 
20 percent of the state's students. In general, it is not used by the 
very largest school districts (which have their own data-processing capa- 
bility) or the very smallest (for which clerical services appear more 
economical) . The average annual cost to the school districts is about 
$4 .00/s tudent for the full subsystem. Within Los Angeles County, 13 of 
the 97 school districts (and one private school) "subscribe" to the 
pupil subsystem. 1 

Regional centers are not restricted to providing only CEIS. The 

Los Angeles District CEIS Office, operating under the aegis of the 

County Board of Supervisors, provides other data-processing services to 

school districts. A series of finance and accounting programs (which 

perform the basic functions of the CEIS business subsystem) are now in 

operation. These are muvJi more widely used by the districts than is the 

pupil subsystem: 92 out of the 97 districts use the payroll subsytem, 

7 use the inventory subsystem, and 29 use the financial reporting 

, ii 

subsys tern . 



CEIS E F FECTIVENESS 

An> judgment of CEIS service must be qualified by an explanation 
of its role: 



Personal communication with CEIS Regional Center, Los Angelen. 

^ibid. 
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o CEIS is not mandated. No district has to use it against its 
will. Therefore, the base of CEIS support (both political and 
financial) is not as broad as it might be. 
o CEIS software is developed by the state, then turned over to 
the Regional Center. From this point on, state officials have 
no real control over CE'.S use, public relations, or maintenance. 
Therefore, the CEIS package may vary widely in effectiveness and 
timeliness from one center t3 another, which accounts for widely 
disparate Judgments of Its value, 
o CEIS development and implementation funds have been extremely 
vulnerable. The level of support has fluctuated dramatically, 
causing uneven and discontinuous development. In addition, fac- 
tors beyond control (such as the bankruptcy of the software con- 
tractor) have severely hampered effective development. 

Remedies for some of these problems are discussed later in this 
section. Our primary concern here is the technical validity of CEIS 
and the worth of its basic concepts. 

On the whole, the basic design of the current CEIS package is ef- 
fective. The regional-center concept allows districts with "middle- 
sized" enrollments to use data-processing services. Most current users 
are districts too small to afford any dedicated computer system yet too 
large to economically perform accounting, personnel, and student-record 
processing manually. The present pupil subsystem offers the mi’.imum 
services necessary to operate a school district. Many features, such 
as "irregular attendance reporting," guidance reporting, and other ex- 
ception and analysis routines will, when implemented, significantly ex- 
tend its capability. 

The business subsystem is also effective by present standards. 

When implemented, it will produce over 50 recurring reports, including 
detailed analyses of personnel characteristics, qualifications, and 
turnover [9]. The business subsystem seems especially comprehensive in 
these areas, providing an effective system of reports both in f . indard 
payroll areas and in areas of interest to personnel administration. 

Final judgment must await implementation, when a determination of actual 
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effectiveness and district costs can be made. In general, however, 

CEIS seems adequate for the current needs of the average district. 

CE IS AND FUTURE NEEDS 

Should some form of accountability and program budgeting become 
reality, CEIS 1 value might diminish considerably. This judgment assumes 
that CEIS will remain essentially the same in concept, organization, and 
generated reports. The more serious problem areas are 

1. Cleavage between business and pupil subsystems: An effective 

program-budgeting system requires that results be related to 
program expenditure. This is done by the decisionmaker, but 
an information system can provide substantial assistance. The 
first step involves relating expenditures, teachers, and stu- 
dents through some unique identifier, such as "program code." 
CEIS currently carries program code as an optional data item 
within the business-subsystem files. This usage must be ex- 
tended throughout the pupil subsystem. In addition „ procedures 
for updating and maintenance must be established. 

2. Lack of program orientation: No provision exists for CEIS to 

report on expenditures or educational outcomes by program. 

Such reporting Is necessary for program budgeting and very 
helpful in an accountability system. In addition, reports 
enabling "crosswalk" bet^ en program and fund (or account) 
would have to be produced. 

3. Lack of planning analytical capability: CEIS is weak in areas 

of trend analysis. Although data are held historically, there 
Is no set of statistical analysis programs; this would help 
provide real Insight into various program outcomes. Such analy- 
ses would also be valuable to ‘he educational planner. 

Other areas related to planning are similarly neglected* Such 
items as resource-modeling techniques, which allow assessment of the 

^Crosswalk Is a well-defined budget accounting by both program and 
account classification. 
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long-term implication of various allocations, are totally absent. Al- 
though such items are not generally considered part of an information 
system, they would greatly aid the educational planner concerned with 
program budgeting and accountability. Furthermore, since CEIS is in- 
tended as a resource for districts, such tools might reasonably accom- 
pany (and be integrated with) the information system. 

Nona of the above is intended as a criticism of either CEIS or its 
designers. It represents a judgment of the shortcomings of CEIS in an 
environment totally different from that envisioned by the initial 
designers . 

Nevertheless, given current levels of funding and interest, the 
ability of CEIS to get from ''here to there ,r Is in doubt. The produc- 
tion of a program orientation and analytical capability for CEIS will 
require both a considerable expenditure and a large preliminary design 
effort to further determine the needs of educators within the context 
of accountability and program budgeting. The magnitude and importance 
of this undertaking should rot be underestimated. A vel l~designed , 
responsive information system can serve as an effective "catalyst" for 
both accountability and program budgeting. Conversely, a poorly de- 
signed system will, at best, only hamper efforts toward these goals; at 
worst, it might make such programs impossible to implement. A recent 
publication of the Advisory Commission on School District Budgeting and 
Accounting described a motion "to write a letter to the State Board of 
Education and the Department of Education ... outlining the need for 
CEIS...".^ Both the Advisory Commission and other sources must provide 
considerably more definition if CEIS is to fulfill its potential. 

A SUGGESTED DEVELOPMENT PLAN FOR CEIS II 

The discussion below outlines a • ->ecific blueprint (here called 
CEIS II) for developing CEIS into an effective and useful information 
system. Although directed toward support of accountability and program 
budgeting, this 7 ' an is equally valid if neither becomes a reality. 

^Ref 7, p. 2 . 
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Befoie discussing the actual design of CEIS II* the larger problems of 
political (and hence financial) climate and commitment must be considered. 

As stated above, CEIS development has continually been a victim of 
the politics of inattention. It has been relegate, to a low-priority 
role, perhaps viewed as a luxury rather than a necessity. However, in 
the future an effective information system may be the keystone of edu- 
cational planning and management. Our fir3t recommendatioi implies a 
confirmation of this fact by the State of California and a consequent 
commitment to create a favorable political-financial atmosphere for 
CEIS development. This commitment might best be expressed by: 

1. Creation of an Advisory Commission on Information Systems by 
the California Legislature. This Commission would operate in 

a manner similar to the Commission on School District Budgeting 
and Accounting. 

2. Appointment to the Advisory Commission of ten members, drawn 
from education, government, and industry. Since primary defini- 
tion of CEIS will come from state program-budgeting require- 
ments, at least three of these members should also be members 

of the Commission on School District Budgeting ana Accounting. 

3. Endowment of the Advisory Commission with sufficient capital 
to contract for the need and requirements definitions outlined 
below. It Is estimated the Commission will require a first- 
year appropriation of $800,000, to be followed thereafter by 
appropriations of $200,000/yr. 

This Commission would elicit, through hearings and study sponsor- 
ships, the general information-system needs attendant to educational 
administration, accountability, and program budgeting and in turn state 
these requirements to the Bureau of Systems and Data Processing for 
Implementation . 

A Three-Phase Development Plan 

The established Commission would be required and etipowered to de- 
fine the future direction of CEIS II and Insure proper Implementation. 
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The following is a suggested schedule for bringing CEIS II to opera- 
tional status within approximately three years. 

Phase I: System Definition (June 1971-May 1972) . During Phase I, 

the Bureau of Systems and Data Processing would retain responsibility 
for maintenance and support of the current CEIS configuration. This 
phase would be devoted to examining the basic issues of CEIS II form, 
development, and implementation. Among the items examined might be: 

o Information needs of decisionmakers: As sketched in Sec. Ill, 

Information needs for effective accountability and program 
budgeting are complex, varied, and largely unknown. Further 
research is necessary through interviews, presentation of hypo- 
thetical examples, and examination of existing supportive in- 
formation systems. 

o Transitional mechanisms : A variety of methodologies are feasi- 

ble for easing the decisionmaker’s transition from the current 
to the projected environment. The best-known of these is the 
crosswalk. Other crosswalks must be developed in both financial 
and nonfinancia? areas to insure that educators are not unrea- 
sonably required to decipher unfamiliar methods and reports. 

In addition, inservice training programs must be devised toward 
this same end. 

o Functional system design: This area Involves a gross determina- 

tion of the form and function of CEIS II, describing (1) which 
data items must be reposited, (2) file structures, (3) file- 
maintenance procedures, (A) data-collection mechanisms, and (5) 
reports to be produced. This effort is the essential precursor 
of the detailed system design outlined in Phase II. 

Attention must also be given to the final Implementation 
form of CEIS II. The degree of autonomy given to regional cen- 
ters and the interconnection mechanism are two major issues to 
be decided. 
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o Legislative framework for Ctilo TI : Should the use of CEIS II, 

or some portions thereof, be mandated? Such a decision nv*ght 
run totally contrary to present philosophies of district auto- 
nomy; on the other hand, if CEIS II-supported accountability 
were shown to be a highly effective means of improving educa- 
tional outcomes, pressures for a mandate might conceivably 
arise. A larger question concerns statewide standards for data 
reporting and record transfer. There are large benefits — and 
large costs--in having standard data-formats for all educational 
data-processing installations. A careful analysis should be 
made to determine an equitable standards policy, 
o Cost ’■sheering strategies : There are a number of methods short 

of a mandate that might make CEIS II more attractive to the 
educational community. One method involves state subsidy of 
CEIS II operations, reducing per-pupil costs below those possi- 
ble with a district-dedicated system. Other forms of subsidy, 
such as county or federal, might also be considered. A third 
alternative involves charging on a basis other than M per pupil ,' 1 
perhaps giving an advantage to the larger districts by charging 
some flat rate plus a reduced amount per pupil, 
o Security and privacy issues: The physical security of many 

data-processing installations is being questioned because of 
recent incidents (e.g. , at Fresno State College) and because of 
the cC T «centra t ion of invested capital and valuable data repre- 
sented by a computer installation. The location and layout of 
the CEIS II regional centers should reflect this concern. 

Safeguarding the information against compromise is a re- 
lated and Central issue. Guidance toward and judgment of edu- 
cational achievement requires a wealth of educational, demographic, 
and personnel data on both teachers and students. Unauthorized 
dissemination of this information could cause extreme embarrass- 
ment (particularly to students), especially within the complex 
social structure represented by a school. 
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Phase II: Pet ailed S y stem Design (March 1972-May 1973) . This phase 

involves translation of the needs, requiremen ts > and gross system speci- 
fications Into a design of the actual CEIS II hardware and softw iLti sy s- 
tem . Specific tasks to be performed in this phase include: 

o Identification of appropriate hardware configurations. 

o Detailed file design. 

o Selection of M of f- the-shelf " software that would perform re- 
quired functions. 

o Design of computer programs to perform functions not available 
through purchased software (or where such purchase is 
uneconomical) . 

o Validation of the chosen hardware-software complex through sys- 
tems simulation. 




Phase II might be carried out in one of two ways. The first in- 
volves assigning responsibility directly to the Bureau of Systems and 
Data Processing, with continued review and major decision-approval re- 
maining with the Advisory Commission. The second involves having the 
Commission request proposals for system design, with the Bureau of Sys- 
tems and Data Processing among those submitting proposals. 

Phase III: Programming and Acceptance Test (June 1973-August 1974 ) . 

This phase involves translating the detailed systems specifications into 
computer programs to accomplish the function specified. It also includes 
new hardware acquisition, if necessary. 

A crucial step in this phase involves preparation by the Advisory 
Commission or its designee of an acceptance-testing procedure. This 
includes detailing specific operational tests that CEIS II must accom- 
plish prior to full implementation. Ihe testing is accomplished with 
dummy data prepared to insure as full a validation of software and hard- 
ware performance as is p ssible within the limits of time and money. 
Numerous instances have been noted where an ill-tested system has been 
offered to users, who inmediately have difficulty with either timeliness 
or accuracy. Forced to go elsewhere for service, the users do not re- 
turn, regardless of changes in the status of the Original service. 
Furthermore, the '*bad press M generated by this situation makes other 
potential users very reluctant to use the system. 

32 ' ; 
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Implementatlon (August 1974-) 

Implementation might best be carried out on a gradual basis. Ini- 
tially, some small number of dist ricts--representac ive in size, sophis- 
tication, and experience — would participate in a final operational 
shakedown. Only after full satisfaction is achieved should the system 
be made fully available to California school districts. As stated 
above, CEIS II may have only one chance with potential users. 

In reality, CEIS II implementation efforts will not stop in 1974. 
Other features may be added as desired and program maintenance will 
continue to be a major effort. Those charged with resource allocation 
should keep this in mind. All the effort described above may be wasted 
if support of CEIS II does not continue at a reasonable level. 

Finally, research and development must continue. The concept em- 
bodied by CEIS II — a computer utility serving the educational community 
--is both sound and capable of providing exceptional benefits to all 
California students* Large areas amenable to automation, such as diag- 
nostic-prescriptive aids, have not been mentioned here yet fit well 
within the CEIS II framework. Every effort should be made toward full 
development of these and other educational tools. 
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